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EXTREMALITY OF QUATERNIONIC JORGENSEN INEQUALITY 


KRISHNENDU GONGOPADHYAY AND ABHISHEK MUKHERJEE 

Abstract. Let SL(2, H) be the group of 2 x 2 quaternionic matrices with Dieudonne 
determinant 1. The group SL(2, H) acts on the five dimensional hyperbolic space by 
isometries. We ask extremality of Jprgensen type inequalities in SL(2,]HI). Along the 
way, we derive Jprgensen type inequalities for quaternionic Mobius transformations 
which extend earlier inequalities obtained by Waterman and Kellerhals. 


1. Introduction 

In the theory of Fuchsian groups, one of the important old problem is the “discreteness 
problem”: given two elements in PSL(2,M), whether or not the group generated by 
them is discrete. For an elaborate account of this problem, see Gilman [9]. Algorithmic 
solutions to this problem were given by Rosenberger [TH] , Gilman and Maskit m, Gilman 
[9]. The Jprgensen inequality [6] is one of the major results related to this problem. 
Jprgensen [6] obtained an inequality that the generators of a discrete, non-elementary, 
two-generator subgroup of SL(2, C) necessarily satisfy. Wada [27] used this inequality 
to provide an effective algorithm that helps the software OPTi to test discreteness of 
subgroups, as well as to draw deformation spaces of discrete groups. 

A two-generator discrete subgroup of isometries of the hyperbolic space is called ex¬ 
treme group if it satisfies equality in the Jprgensen inequality. Investigation of extreme 
groups in SL(2,C) was initiated by Jprgensen and Kikka [7]. Following that, there have 
been many investigations to classify the two-generator extreme groups in SL(2, C), for eg. 
see [ini[i2]. In a series of papers, Sato et. al. [E]- m have investigated this problem in 
great detail and provided a conjectural list of the parabolic-type extreme groups. Calla¬ 
han [3] has provided a counter example to that conjecture. Callahan has also classified 
all non-compact arithmetic extreme groups that was not in the list of Sato et. al. The 
problem of classifying parabolic-type Jprgensen groups in SL(2, C) is still open. Recently, 
Vesnin and Masley [26| have investigated extremality of other Jprgensen type inequalities 
in SL(2,C). 

The problem of classifying extreme Jprgensen groups in higher dimension has not 
seen much investigation till date. The aim of this paper is to address this problem 
for Jprgensen type inequalities in SL(2,]HI), where El is the division ring of the real 
quaternions and SL(2,BI) is the group of 2 x 2 quaternionic matrices with Dieudonne 
determinant 1. It is well-known that SL(2, H) acts on the five dimensional real hyperbolic 
space by the Mobius transformations (or linear fractional transformations), for a proof 
see m- The isometries of are classified by their fixed points as elliptic, parabolic 
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and hyperbolic (or loxodromic). This classification can be characterized algebraically by 
conjugacy invariants of the isometries, see [Ml EZl mi [2] for more details. 

The Jprgensen inequality has been generalized in higher dimensions by Martin m 
who formulated it by identifying the hyperbolic space as the upper half space or the unit 
ball in Hence, in Martin’s generalization, the isometries are real matrices of rank 

n + 1. Generalizing the approach of using rank two real and complex matrices in low 
dimensions, Ahlfors [T] used Clifford algebras to investigate higher dimensional Mobius 
groups. In this approach, the isometry group of the hyperbolic n-space can be identified 
with a group of 2 x 2 matrices over the Clifford numbers, see Ahlfors [T], Waterman [28] 
for more details. Using the Clifford algebraic formalism, a generalization of Jprgensen 
inequality was obtained by Waterman [28] . However, it may be difficult to deal with the 
Clifford matrices due to the complicated multiplicative structure of the Clifford numbers. 

Using the real quaternions there is an intermediate approach between the complex 
numbers and the Clifford numbers, that should provide the closest generalization of the 
low dimensional results for four and five dimensional Mobius groups. The Clifford group 
that acts by isometries on the hyperbolic 4-space, is a proper subgroup of SL(2,]HI). 
So, Waterman’s result restricts to this case. Kellerhals m has used this quaternionic 
Clifford group to investigate collars in H^. Recently, Tan et. al. [25] have obtained 
a generalization of the classical Delambre-Gauss formula for right-angles hexagons in 
hyperbolic 4-space using the quaternionic Clifford group of Ahlfors and Waterman. 

The Clifford group that acts on H^, however, is not a subgroup of SL(2,1HI). In fact, 
the group SL(2, H) is not in the list of the Clifford groups of Ahlfors and Waterman. 
However, following the approaches of Waterman, it is not hard to formulte Jprgensen 
type inequalities for pairs of isometries in SL(2,]HI). Kellerhals [13] derived Jprgensen in¬ 
equality for two-generator discrete subgroups in SL(2,]HI) where one the of the generators 
is either unipotent parabolic or hyperbolic. 

Using similar methods as that of Waterman, we give here slightly generalized versions 
of the Jprgensen inequalities in SL(2, H) when one of the generators is either semisimple 
or fixes a point on the boundary, see Theorem 13.11 and Theorem 13.71 in Section |3l As 
corollaries we derive the formulations by Kellerhals and Waterman in the quaternionic set 
up, see Corollary 13.21 and Corollary 13. 101 respectively. We also formulate a Jprgensen type 
inequality for strictly hyperbolic elements that is very close to the original formulation 
of Jprgensen, see Corollary 13.41 We recall here that a strictly hyperbolic element or a 
stretch is conjugate to a diagonal matrix that has real diagonal entries different from 
0, 1 or —1. We also give as corollaries two weaker versions of the inequality when one 
generator is semisimple. 

We investigate the extremality of these Jprgensen inequalities in Section |4| We ex¬ 
tend the results of Jprgensen and Kikka in the quaternionic set up, see Theorem ST] 
Corollary 14.21 and. Theorem l4.6l We also obtain necessary conditions for a two-generator 
subgroup of SL(2,]HI) to be extremal, see Corollary 14.51 and Corollary 14.71 

2. Preliminaries 

2.1. The Quaternions. Let El denote the division ring of quaternions. Recall that every 
element of BI is of the form oq -|- aii -|- 02 j -|- a 3 A:,where oq, oi, 02,03 G M, and i, j, k satisfy 
relations: = —l,ij = —ji = k,jk = —kj = i,ki = —ik = j, and ijk = — 1 . 

Any a G El can be written as a = ao + aii + a 2 j -|- a^k = (oq -|- aii) + (02 -|- a 3 i)j = z + wj, 
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where z = ao + aii, w = a 2 + a^i G C. For a G EI,with a = ao + aii + a 2 j + 03 /?,we define 
3ft(a) = ao=the real part of a and ^{a) = aii + a 2 j + a^k = the imaginary part of a. 
Also,dehne the conjugate of a as a = 3ft(a) — ^^(a) If 3ft(a) = 0 ,then we call a as a vector 
in El which we can identify with The norm of a is |a| = + Og. 


2.1.1. Useful Properties. We note the following properties of the quaternions that will 
help us further: 

(1) For X G R, a G H, we have ax = xa. 

(2) For a G C, aj = ja. 

(3) For a, 6 G H, \ab\ = |a|| 6 | = \ba\ and if a 7 ^ 0,then a~^ = 

Two quaternions a, b are said to be similar if there exists a non-zero quaternion c such 
that b = c~^ac and we write it as a ^ b. Obviously ' is an equivalence relation on H 
and denote [a] as the class of a. It is easy to verify that a ^ 6 if and only if 3ft(a) = 
and |a| = | 6 |. Equivalently, a ^ 6 if and only if 3ft(a) = and |^^(a)| = |^^(fc)|. Thus 
the similarity class of every quaternion a contains a pair of complex conjugates with 
absolute-value |a| and real part equal to 3ft(a). Let a is similar to re*®, 6 G [— 7 r, 7 r]. In 
most cases, we will adopt the convention of calling | 6 *| as the argument of a and will denote 
it by arg(a). According to this convention, arg(a) G [ 0 , 7 r], unless specified otherwise. 

Suppose a quaternion q is conjugate to a complex number 2; = re*“. Since 
and |g| = \z\, it follows that \^q\ = |$^2;| = |rsinQ;|, i.e. | sinal = - 4 ^. 


2.2. Matrices over the quaternions. Let M(2,]HI) denotes the set of all 2 x 2 ma¬ 
trices over the quaternions. If A = , then we can associate the ‘quaternionic 

determinant’ det(A) = \ad — aca~^b\. A matrix A G M(2,BI) is invertible if and only if 
det(A) / 0. Also, note that for A,B £ M(2,]HI), det(Ai?) = det(A) det(i?). Now set 

SL(2,H) = I e M 2 ( 1 I) : det = |ad - aca-^b] = l|. 


The group SL(2, H) acts as the orientation-preserving isometry group of the hyperbolic 
5-space H^. We identify the extended quaternionic plane H = BI U 00 with the confor¬ 
mal boundary of the hyperbolic 5-space. The group SL(2,]HI) acts on H by Mobius 
transformations: 

^^:Ze^{aZ + b){cZ + dr\ 

The action is extended over by Poincare extensions. 


2.3. Classification of elements of SL(2,]HI). Every element A of SL(2,]HI) has a fixed 
point on the closure of the hyperbolic space and this gives us the usual classification 
of elliptic, parabolic and hyperbolic (or loxodromic) elements in SL(2,]HI). Further, it 
follows from Lefschetz hxed point theorem that every element of SL(2, H) has a fixed 
point in conformal boundary. Up to conjugacy, we can take that fixed point to be 00 and 
hence every element in SL(2,]HI) is conjugate to an upper-triangular matrix. 
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We would like to note here that an elliptic or hyperbolic element A is conjugate to a 
matrix of the form 

A 0 
0 

where A, /r G C. If |A| = |/i|(= 1) then A is elliptic. Otherwise it is hyperbolic. In the 
hyperbolic case |A| / 1 / |^| and |A||/r| = 1. A hyperbolic or loxodromic element will 
be called strictly hyperbolic if it is conjugate to a real diagonal (non-identity) matrix. A 
parabolic isometry is conjugate to an element of the form 


(o a) ■ 

For more details of the classification and algebraic criteria to detect them see miiiKini 

dz]. 


2.4. Conjugacy invariants. According to Foreman [5] the following three functions are 
conjugacy invariants of SL(2,BI): For A = d) ^ SL(2,BI), 


^ = - ^(abc) - iStibcd) 

= ?fi[{ad — bc)a + {da — cb)d], 

-f = jA = lap + |dp + 43?(o)3?(d) - 23?(6c) 

= lap + |dp + 2[3?(ad) + 3?(ad)] - 2^{bc) 
= |a-|-dp-b 23ft(ad — 6c), 
d = 6A = 5R(a) + 5R(d) = 5R(a + d) 


Parker and Short [I7j defined another two quantities for each A G SL(2,EI) as follows: 

a = aA = cac~^d — cb, when c 7 ^ 0 , 

= bdb~^a,when c = 0,b 0, 

= {d — a)a{d — a)~^d, when b = c = 0,a ^ d, 


T = TA 


aa, when b = c = 0,a = d 

cac~^ + d, when c / 0 

bdb~^ -b o, when c = 0,6 / 0 

{d — a)a{d — a)“^ -b d, when b = c = 0,a ^ d 

a + a, when b = c = 0,a = d 


It can be proved that in each case |(Tp = a = 1,where 

a = UA = |ap|dp + | 6 p|cp — 2iR.{acdb). 
We are going to show that y/a = det{A) = |ad — aca~^h\ = |(t|. 


Lemma 2.1. If A 


G M(2,EI), then yfa = det{A) = \ad — aca ^b\ 


a 
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Proof. We observe that 

{det{A))‘^ = \ad — aca~^b\'^ = {ad — aca~^b){ad — aca~^b) 

= {ad — aca~^b) {da — te“^ca) 

= |ap|dp + — adba~^ca — aca~^bda 

= \a\^\d\^ + \b\^\c\^ — 2 ‘R{aca~^hda) 

= |a|^|dp + |&P|c|^ — 2 ^{cabd) = |ap|dp + | 6 p|c|^ — 2 ^{acdb) = a. 

This completes the proof. □ 

2.5. Some Observations. It can be checked that a = a a = \hj'\^ = kijPj 1 < b J < 2, 
where kj, rij are defined as follows: 

li2 = bdb~^a — be 
I22 = ad — aca~^b 
ri2 = db~^ab — cb 
r22 = da — ca~^ba 

G M(2,]HI) be such that det{M) 7 ^ Q.Then M is 
~^b\ f drii~^ —bri2~^'' 


III = da — dbd~^c 
hi = cac~^d — cb 
rii = ad — bd~^cd 


Theorem 2.2. 

invertible 


r 2 i = ac dc — be 
Let M = 


a b 
c d 


M-^ = 


-1 


11 


d -I 


I 

-hi~'^c l22~^a j \-cr21 " ar22 


12 
-1, 


-1 


-1 


2.6. Notations. For our convenience we use the following notations: 


= Ifld, 


= I 


21 


b- = 


rs/ 7 — 1 

Qj - 22 ^ 


d~ = dr 


-1 
11 > 


c~ = cr, 


21 5 


6~ = br 


-1 
12 > 


a~ = ar. 


22 


Kellerhals has proved some interesting properties of these numbers given by following 
lemma: 


Lemma 2.3. [H] Let M = dj ^ M(2,]HI) be invertible. Then we have the following 
properties: 

(1) ad -6c~ = 1 = da - cb~, d'"a — c = 1 = a^d — c^b. 

(2) ad~ — 5c~ = 1 = doT' — cb'^, d~a — b~c = 1 = a~d — c~b. 

(3) a6~ = ba^,cd^ = dc^, a^c = c^a, b^d = d^b. 

(4) ab'^ = ba'-', cd~ = dc~, a~c = c~a,b~d = d~b. 

3. J0RGENSEN INEQUALITY FOR SL(2,]H) 

The following proposition gives a Jprgensen inequality for a two-generator subgroup 
of SL(2,]HI) when one of the generators is semisimple. 


a b 
c d 


A 0 


andT^ 'o' i)- ^ is not similar to pL, generate a 


Theorem 3.1. Let S = 

discrete non-elementary subgroup o/SL(2,]HI). Then 

{(5RA - + (|9A| + \^fr\f}{l + \bc\) > 1. 
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Proof. Let us suppose that Kq = {(3ftA — + (|9A| + |9^|)^}(1 + \bc\) < 1. 

Consider the Shimizu-Leutbecher sequence defined inductively by 


Now, 

(3.1) 

(3.2) 

(3.3) 

(3.4) 


5o = 


ao bo 
Co do 


= S = 


(Q, b\ „ _ f Cln+l &n+l \ _ Q 

Vc d)^ ^^+^-[cn+l • 




n+1 


= Sr^TS-^ = 


CfiX dfiXj y 

QfiXd^ 

CfiXdj^ dnfJ^c^ 
( ^n+1 ^n+1 I 

dn+1 ) 


X o\(d- 
0 V-cJS 


-bZ 


^nXb^ “h b^filJiCL^ 
^nXb^ “h dfifJjCl^ 


-ft; 

aZZ 


So, 


^n+l — (InXd^ bfifJjCy.1^ , 

Cn-\-l — CfiXd^ dfiflCj^ , 


&n+l — (^nXb^ -\- bfifXCl^ 
dfi^i — CfiXb^ -\- dfil-i'dy^ 


Now, we have 


I b'fi-\-i 11 Cn-i-i 


|( ^nXb^ -\- bfifjjCi^)(^CfiXd^ dfific^^l 

I 11 bnlJ'Oj^b^ ||A dnf^Cr^d.^ 


By an easy computation, we see that 
|A — a~^bn/~ia'^b'^~^\ = |3ftA + ZsX — — a~^bn{Zsfj,)a'^b'^^ 


-ii 


since anb^ = bncQ 


= |(3ftA — + $>A — a^^bn{^p)ci^b^ 


-ii 


= \l (5RA - + I^A - an^6„(9^)a~6~-i|2 

< V(5RA-3ft^)2 + (|$>A| + |9;U|)2. 

Similarly, we may deduce that |A — < y(3ftA — 3ft^)2 + (|9A| + |$^/u|)2. 

Therefore, 


(3.5) |6n+l||Cn+l| < \anbnCndn\{{^^ - + (I^^AI + IQ’/Uy} 


Since \andn\ < 1 + \bnCn\, this implies 

(3.6) |6„+l||Cn+l| < {(5RA - + (|$>A| + |$>^y}(l + \bnCn\)\bnCn 


Since, Ko = {(3ftA — + (|$^A| + |$J^y}(l + \bc\) < 1, by using induction process 

we have the relation, \bn+iCn+i\ < Ko\bc\ bnC^ ^0, as n ^ oo, and so, Ond^ = 
1 + bncfl —^1, as n ^ oo. 

Since, |an+i| = \anXdf^ — bnfrc'^\, |(in+i| = | — CnXb'^ + (i„/ua~|, we have 
I A| II 1^11 bnCj^ I ^ IUn+iI ^ I A| I andj^ I T 1^11 &nCjj I ^ IOn+i| ^ I A|, as n ^ oo. 
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Similarly, we have |(in+i| ~^ |/^|) as n —oo. 
Again,we have 


\bn+i\ = I - anXb^ + bnfj.a'^^^l = Wnb^WX - a^^bniiol^bn 

< \anhnWm - + (I^A| + |9//|)2 

< A'o|an|| 6 „| -Aol^^nl, since \an\ 1 . 

< AIq 1^1 0 ) since Kq < 1 . 

Thus, for all positive integers, \bn\ —>-0 as n ^ oo, i.e. bn ^ 0 as n —)> oo. 

Similarly, we may show that ^ 0 as n —)• oo. 

Thus the sequence Sn has a convergent subsequence and since the subgroup {A, B) is 
discrete, so we arrive at a contradiction. This proves the theorem. □ 

Corollary 3.2. Let ^ ^ ^ ~ (o h) ^ SL(2,]HI), A is not similar to /r, 

generate a discrete non-elementary subgroup {S,T) o/SL(2,EI). Then 

2(coshT — cos(q: + /3))(1 + \bc\) > 1, 
where a = arg{X), /3 = arg{fi), r = 21og|A|. 

Proof. Without loss of generality, assume |A| = r > 1. Observe that, 

{^X - + {\^X\ + 

= (r COSO-cos/3)^ + (r| sina| H—| sin/3|)^ 

r r 

= H —- — 2(cos a cos j3 — \ sin a\\ sin /3|) 

= 2 (coshr — cos(a +/?)), where r = e 2 , r > 0. 

This completes the proof. □ 


Remark 3.3. Kellerhals m Proposition 3] proved the above result assuming T hyper¬ 
bolic, i.e. when r 7 ^ 0. However, it follows from above that Kellerhals’s result carry over 
to the elliptic case as well, i.e. when r = 0 . Also we have avoided the normalization 
of the constant term of (1 -|- \bc\) in the inequality to make it sharp. The Theorem 13.11 
also extends Waterman’s Theorem 9 in [28] when restricted to the quaternionic set up. 
Note that SL(2,]HI) is not a Clifford group and hence. Theorem 9 of Waterman does not 
restrict to SL(2,E[). For example, the element 


T = 




does not belong the Clifford group SL 2 (C' 2 ), see [28l p. 95], but it belongs to the group 
SL(2,]HI). This class of elements are also covered by Theorem 13.11 


The next theorem generalizes the Jprgensen’s inequality in SL(2, H) for strictly hyperbolic 
elements with some given conditions. The formulation resembles the original inequality 
by Jprgensen. 


Corollary 3.4. Let A,B^ SL(2,]HI) be such that both A and the commutator [A, H] are 
strictly hyperbolic. If {A,B) is a non-elementary discrete subgroup o/SL(2,]HI), then 

\^\ — 4| -I- — 2| > 1. 
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Proof. Let A = 


Q ), where k > 1 and B = 


a b 
c 


So, 6a = k + k ^ ^ \6\ — 4| = KA; + A: — 4| = |A: — A: 

Now, 


with c 7 ^ 0. 


AB = 
ABA-^B-^ = 


k 0 
0 k-^ 


a b 
c d 


ka kb 
k~^c k~^d 


ka kb 
k~^c k~^d 

c~^da~^c —a~^ba~^cac~^ 


—a 


k-^ 0 
0 k 

a k^b\ (c~^da~^c —a~^ba~^cac~^ 
k~‘^c d 


a ^cac ^ 


—a 


a ^cac ^ 


ac 


^da — kfba 
{k~‘^ — l)da~^c da~^cac~^ — k~‘^ca~^ba~^cac 


(A:^ — 1)6(7 ^cac ^ 


So, we have. 


^{ac~^da~^c — k‘^ba~^c) + ^{da~^cac~^ — k~^ca~^ba~^cac~^) 

= 'St{ac~^da~^c) — k‘^^{ba~^c) + ^{da~^cac~^) — k~‘^'St{ca~^ba~^ cac~^) 
= 2^{cac~^da) — {k^ + A:“^)3?(6ac) 

= 2(1 + 3ft(c6a)) — (A:^ + A:“^)3ft(6CTc), since a = cac~^d — cb. 

= 2 - {k^ + k-^ - 2)^{bac) 

= 2-{k-k-^f^{bac). 

This implies that \6aba-^b-^ ~ ‘A — ~ k~^\‘^\‘Si{bac)\. Since ABA~^B~^ is strictly 

hyperbolic, we have 

bac = bdcd — |6cp ^ 3?(6ac) = ^{bdcd) — |6c|^ = 5R(acd6) — |6cp. 


Also, we have bacac~^ = 0 =>■ b{cac~^d — cb)cac~^ = 0 ^ |6p(|adp — bacd) = 0 ^ 
\ad\‘^ = bacd since be ^ 0, for otherwise {A,B) becomes elementary. This shows that 
bac = |adp — |6cp = 3?(6ctc). Thus, 

14 - 4| + |6asa-is-i -A = \k- k-AHl + \bc\). 

Now the theorem follows from Theorem KT\ □ 

The following two corollaries give weaker versions of Theorem 13.11 


a b 


A 0 


0 /i 


Corollary 3.5. Suppose S' = and T = 

discrete subgroup in SL(2,EI). Then we have 

(3{T)L’^ > 1, 

where 

ld{T)= sup |(A - e^e"^)(A - 

e,/5^0,oo 

L = 1 + \p.\ and A; = [1 + |6c|] + 1, 
[ . ] denotes the greatest integer function . 


generate a non-elementary 
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Proof. Since L > 1, k > 2, note that 1 + \bc\ < k < L^. Let 

K = {^X- + (|$>A| + 

Using conjugation if necessary, suppose without loss of generality that A, jj, are complex 
numbers. Note that, both /3(T) and K are invariant if we conjugate the matrix T in the 
above theorems to a diagonal matrix in SL(2,]HI) over the complex numbers. Note that 


|A - jfj-j ^1 = \/ (5RA - + (|9A|2 + |9|u|2), 

hence K < (3{T). 

Further note that a diagonal element T G SL(2, H) can be conjugated to a diagonal 
matrix T' G SL(2,C) and the conjugation is done using a diagonal element in SL(2,]HI). 
So, given {S,T) as in the above results, if we conjugate it to {DSD~^, DTD~^), where 
D a diagonal matrix in SL(2,]H1), then the conjugation makes DTD~^ a diagonal matrix 

over C. And further, it is easy to check that if DTD~^ = , then \b'(f\ = \bc\. 

Thus conjugation of {S,T) by a diagonal matrix in SL(2,]HI) does not change the left 
hand sides of the above inequalities. 

Since {S,T) is discrete, non-elementary, K{1 + |6c|) > 1. Hence 

(3{T)L’^ > A:(1 + |6c|) > 1. 


a b 
c d 


Corollary 3.6. Suppose 5 = ( ,1 and T = 

discrete subgroup in SL(2,]HI). Then we have 

/3(T)(l + |6c|)>l, 

where ld{T) = sup |(A — e/re“^)(A —//u/“^)|. 

e,/^0,oo 


A 0 
0 n 


□ 


generate a non-elementary 


The next theorem gives Jprgensen inequality for a two-generator subgroup where one 
of the generators fixes oo. 

Theorem 3.7. Suppose •S' = ^ and T = ^ , where 3ftA = IRp, / 0, |A| < 1 < 

1^1, generate a non-elementary discrete subgroup in SL(2,]H1). Suppose 
S{X,fj,) = |^|(|$JA| -|- l^^l) < Then we have 


|c|Vko||io| > 


l + ^l-AV2S{X,ia) 


where tq = A(—c ^d) -|- ?? + (c ^d)p and, to = A(ac ^) + ?? — (ac ^)pL. 

Proof. Let a = argA, fd = arg^. Denote r = |A|, where we see that r^cosa = cos/3. 
Consider the Shimizu-Leutbecher sequence 


So = S, Sn+i = SnTSn \ where S'n = 


dr 
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5„+i = SnTSn 


dn bn\ /a r/A f 

Cn dnj yO nj \y — C^ J 

ttfiXd^ Oin'IJ^n + OinTfChn 

CyjAdyj CnTjC^ dnfJ-C^ CnXb^ + CnTjQ,^^ -|- dnj-tO,^ . 


Define Tn,tn by 

(3.7) 

Tn — A( Cn dn) Tj {Cn dn)^ 

(3.8) 

tn — ^{,^71^71 ) “1“ ^ (^n^n )/i- 

Since 3ftA = by assumption, using this we obtain 

(3.9) 

Tn — ^A( Cn dn) Tj {Cn 

(3.10) 

tn = $>A(anCri“^) + 7/ - (anCn“^)9M- 

We see that 



C-n +1 — CfjAdjj CnC^ dnXc^ 

= Cn(AyA((i;;;c~“^) -rj- (cn“^(in)Ay/u)c~ 

= -Cn{^X{-Cn~^dn) + T] + {c~^ dn)^ fJ,} 

— C^n'^n^n 
^ |Cn+l| — I'^nCTT,! I^T^I • 

dn+\ — -\- CyiTjCl^ + dfiflO,^ 

= 5RA(dna;;; - Cnb':;^) + cn{AyA(-6;;;a;;;“^) + ?? + {cn~^dn)^ijX\oX;i 

= 3 ftA + Cn{AyA(an“^c;;;“^ - Cn~^dn) +r] + (Cn“^(in)AyM}an 
= T cos (X “1“ CfiTfiClj^ “1“ Cfi^X OjYi (l^ 

By similar computations, we have 

On+l = r cos a - anTnC^ + c~. 

Using above equalities, we see that 

En+l — A'A( C^_i_-^dn-\-i') “b + (c^-i-i dn-{-l)^fX 

= '^X{Cn~^Tn~^Cn~^ir cosa + CnTna'^ + Cn^X an“^c~“^a~)} + 

V - {c~“Vn“^Cn“Hr cosa + CnTna~ + Cn'^X an“^c~“^a~)}by^ 
= tn + r cos a bvA C^~^Tn~^Cn~^ + AvA C~“^rn“^9A an~^C~“^a~ - 


— 1 —1 —lo- — 1 —1 r'-\ 

r cos a Tn Cn ^/i — Tn a> 


— 1 — 1 


\Tn+l\ < \tn\ + 


(r^l sinal + | sin/3|)(| cos a\ + | sinal) 


-, using, |a„| = \an\\l 22 l> 


1^22^1 = det S'n = 1, and, |9A| = |A|| sina|, = |^|| sin/3| 


|rn+ic„+i| < \TnCn\\tnCn\+ V2S{X,ij), since, | COS a| + | sina| < \/2, where, 
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5(A,/i) = (I sina| + |/x|^| sin/3|) 


IssAi + iaH). 

Similarly we also have, 

|^n+lCn+l| ^ I'^nCnl l^nCnl H“ '\/2*S(A,//) 

In a similar way we can have 

|^n+l| ^ I'^nCnll^nl H“ 2r 

, . , ,, , 2 

^n+l ^ H 

r 


Also, |6n+l| < \an\^+ rS{\,ix)\an\\br, 
Considering the sequence 


Xo = Iciyirolltol, Xn+i = x\ + V2S{\,^i). 

If 0 < xo < 4^5(A,/j) ^ then {xn} is a monotonically decreasing sequence of 

real numbers and is bounded above by converges to ^ 4 a/2.5'(A,m) ^ 


Hence 


1 + - 4V25(A,//) 

\tnCn\ < - - --< 1, and 


MnCn 


—-< 1. 


One a subsequence \tnCn\ and \TnCn\ converges to values at most ^ . Hence 

on a subsequence \an\, \bn\, \cn\, \dn\ converge. In particular, \cn\ —)• 0. Note that / 0 
unless c = 0 and c can not be zero as the group {S, T) is non-elementary by assumption. 
This proves the theorem. □ 

Corollary 3.8. Suppose ^ ^ ^ ~ (o ’ where 3ftA = / 0, r/ / 0, 

|A| < 1 < \p\, generate a non-elementary discrete subgroup in SL(2,EI). Suppose, 

5"(A,/i) = T^d^AI + |9=//|). 


Then we have 


j— l + ^l-4V2|r/|2S'(A,/x) 


'OIROI — 


2 |r?| 


where Tq = A(—c ^d)p ^ + 1 + (c ^d)p,p ^ and, tg = A(ac ^ + 1 — (ac 

Proof. If ?? 7 ^ 0, we write tq = TqP and tg = t'^p. Then the result follows from the 
inequality in Theorem 13.71 □ 
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Corollary 3.9. Suppose S = 


a b 
c d 


and T = 


A r] 

0 li 


, where = 0, |A| < 1 < 


\fi\, generate a non-elementary discrete subgroup mSL(2,EI). Suppose ^(A,//) = |^|(|$jA| + |9'//|) 
Then we have 




where tq = A(—c ^d) + ?? + (c ^d)ia and, t^ = X{ac ^) + 1] — {ac ^)p. 

Proof. In this case, we proceed as in the proof of the previous theorem. The only differ¬ 
ence from the previous proof is essentially the following bound: 

(r^l sin a\ + \ sin / 


|Pn-|-l| ^ l^nl T 




sma . I I II,-1, 

-, using, |a„| = \an\\l 22 


1^22^1 = det S'n = 1, and, |9A| = | A| | sin q:|, |9,u| = |/r| | sin/3| 


=^\Tn+lCn+l\ < |rnCn||tnCn| + 5'(A,/l), where, 


S{X,p,) = (I sin q;| + |//p| sin /3|) 

= (^ + |mI|9(<I) 

= l/^l(|3=A| + 

Noting this bound, the rest is similar. 


□ 


Given any parabolic transformation in SL(2,]H), it is conjugate to a transformation of 
the form 

^=(o 1)' 1^1 = 1- 

and moreover, one can choose 3ft(A) = 0 up to conjugacy. Thus, using Corollary 13.91 gives 
Waterman’s result [28l Theorem 8] in SL(2,EI). 


Corollary 3.10. If S = 


a b 
c d 


T = 


X 1 
0 A 


= 1 generates a non-elementary 


discrete subgroup in SL(2,EI) with T parabolic fixing oo, then 


|c|\/|r(ac ^) — ac ^ 


) - ac-^^\T{-c-H) - {-c-H)\ > ^ + ^1 


Proof Note that T(ac“^) = (A(ac“^)-|-1)A“^ and T(—c“^d) = (A(—c“^d)-|-1)A“^. Now, 
r(ac“^) —(ac“^) = (A(ac“^)-|-1 —(ac“^)A)A“^ =toA“^. Similarly, T(—c“^(i) — (—c“^(i) = 
ToA“^. Since |A| = 1, the result follows. □ 


Recently, Erlandsson and Zakeri [3] have proved a more geometric version of Theo¬ 
rem [37n Their geometric inequality does not depend on any quantity like S{X,fi). Also, 
in the asymptotic case, it covers some of the two-generators groups whose discreteness 
remain inconclusive by Corollary 13.101 However, the inequality of Erlandsson and Zakeri 
does not involve the algebraic coefficients of the matrices. In that sense, the theorems 
in this paper give a more explicit algorithm involving the matrix coefficients to test 
discreteness. 
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Using similar argument as in the proof of Theorem 13.71 we can also prove the following 
theorem that gives Jprgensen inequality for a two-generator subgroup where one of the 
generators has a fixed point 0. 


Theorem 3.11. Suppose ^ ^ ^ ~ ’ where 3?A = = k, 

|A| < 1 < lul, generate a non-elementary discrete subgroup in SL(2,]HI). Suppose, 
S{X,n) = |/i|(|9A| + |9/i|) < e. Then 


|c|vNN > 


1 +Vl-e-i5(A,^) 


where tq = p-i—b ^a) -\- p -\- [b ^a)A, to = p{db ^) + — {db ^)A and e 

depending upon k ^ 0 or n = 0. 


1 

4 V 2 


or 


1 

4 


4. Extremality of Jorgensen Inequality 
The following theorem generalizes Theorem-1 of Jprgensen-Kikka [7]. 

"A 0 


Theorem 4.1. Let S = 


a b 
c d 


0 p 


E SL(2,EI). Suppose, {S,T) is 


and T = 

discrete, non-elementary and for a = arg{X), jd = arg{p), r = 2 log |A|, 
{(3f?A - ^p)"^ + (|9A| + |9/i|)^}(l + \bc\) = 1. 

ITe consider the Shimizu-Leutbechar sequence 

So = S, Sn+l = SnTS-\ 

Then T and Sn+i = SnTS~^ generate a non-elementary discrete group and 
{(5RA - ^pf + (|9A| + \^p\f}{l + \bnCn\) = 1. 

Proof. We consider the Shimizu-Leutbechar sequence 


So = S, 

From relation (3.1) we get 

®n+l — OinXd^ bnpCy.^ , 
Cn+1 — CnAd^ dnPCj^ , 


S„+1 = SnTS, 


-1 


bn+i — (^nXbj,^ bnpa.^ 
dn+l — CnA6jj “1“ dnPOj^ 


and we also have, 

I ^n-i-i 11 Cji+i I — |( CLnXb^ -|-) (c^^Ad^ 

= \anbnCndn\\\- 11 A - c~^dnpa^d'f^~^ 

This implies, (see (13.611 in the proof of Theorem I3.1|l 

(4.1) \bn+lCn+l\ < {(J?A - iRpf (|7yA| |9=/l|)^}(l -h \bnCn\)\bnCn\. 

Let 

(4.2) K = + {\^X\ + \^p\f. 

Construct the sequence Wn where 

Wo = \bc\, Wn = \bnCn\- 
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It follows from (SH) that Wn+i < Kwnil + Wn)- Now note that K{1 + wq) = 1. Now 
wq 7 ^ 0, for otherwise, S and T will have a common hxed point. Hence K < 1. 

Observe that 

1 < K{1 + wi) < K{1 + Kwo{l + tco)) < K{1 + Wo) = 1, 

and hence K(1 + rci) = 1. By induction it follows that K(1 + Wn) = 1 for all n > 0. 
Since K < 1, it follow that Wn 7 ^ 0 for all n and hence the result follows. □ 

The following corollary generalizes Theorem-2 of Jprgensen and Kikka [ 3 . 

Corollary 4.2. Let ^ ^ T = ^ SL(2,]HI). If {S,T) is discrete, 

non-elementary and 

{(3?A - + (|3A| + |9/r|)2}(l + \bc\) = 1, 

then T is elliptic of order at least seven. 

Proof. If possible suppose T is hyperbolic. As in the above proof, it follows from the 
extremal relation that K <1. Now, Let argA = a and argp. = /3. Then 

K = (3f?A-5R/r)2 + (|9A|+ |9/r|)2 

= |A|2 + |//|2+ 2(|9Ap^|-5RA5R/i) 

= |Ap -|- I/ip + 2| sina|| sin/3| — cosacos/3 
= |ApI/ip - 2cos(a +/3). 

Let |A| = 62 . Then using cosh(r) = ^ , observe that 

K = e’’ + e~'^ — 2 cos(a -|- /3) 

> e^ + e“^ + 2 = (ei-he"i)^ 

Since ez + e “2 > this implies K > 1. This is a contradiction. Hence T must be 
elliptic. 

Since T is elliptic, r = 0. Now, K = I implies, cos(q: + /3) > ^. Thus 0 < a -|- /3 < |. 
This implies that the order of T must be at least seven. 

This completes the proof. □ 

Corollary 4.3. Let S = and ^ E SL(2,H). Suppose, {S,T) is 

discrete, non-elementary and 

/3(T)(l + |5c|) = l, 

then T is elliptic of order at least seven. 

Proof. Suppose, up to conjugacy. A, /i are complex numbers. Then K < (d{T). Since 
{S,T) is discrete, we must have K{1 -\- \bc\) > 1. Hence the equality in the hypothesis 
implies iL(l -|- |6c|) = 1. The result now follows from the above corollary. □ 

Corollary 4.4. Let S — (^ ^ ^ ~ (^0 ^ SL(2,]HI). If {S,T) is discrete, 

non-elementary and 

/3(r)L" = 1, 

where A: = [1 -|- |6c|] +1 > 2 and L = l-\-\fj.\ > 1, then T is elliptic of order at least seven. 
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Proof. Up to conjugacy, we assume A, /i are complex numbers. It is enough to show that 
K{1 + \bc\) = 1, where K = (3ftA — + (|9A| + Since the subgroup {S,T) 

generates a discrete non-elementary subgroup of SL(2,BI), then we have K{1 + \bc\) > 1. 
Now note that 

This imples, K(1 + \bc\) < 1. Hence, K{1 + |6c|) = 1. The result now follows from 
Corollary 14.21 □ 


The following characterizes non-extreme groups. 


Corollary 4.5. Let S = 


a b 
c d 


and T = 


A 0 
0 ^ 


generate a discrete non-elementary 


subgroup in SL{2,'E.). Suppose 


||ad| — 1| > (cot^ ~ 

Then {S,T) is not an extreme group. 

Proof. If possible suppose {S,T) satisfy equality in Jprgensen inequality. Note that, it 
follows from the equality in Jprgensen inequality that 

1 - K 


(4.3) 


\bc\ = 


K 


where K = (3ftA — + (|9A| -|- . The condition |(t| = \ad — aca ^6| = 1 implies, 

1 < |od| -|- \bc\ 

=> |ad| > 1 — \bc\ 

= K{1 + \bc\) — \bc\ 


= K + {K-1)- 

= 2-1 
K' 


K 


This implies 

(4.4) |ad| > 1 — \bc\. 

Also we have from |(t| = 1 that |ad| — |&c| < 1. This implies |ad| < 1 + |6c|. Combining 
this with (031) we get 

||ad| — 1| < \bc\. 

Now we see that K = 2(1 — cos(a -)- /3)) and, 

1 — K 2 cos(a + (5) — 1 


\bc\ = 


K 2 — 2 cos(a -|- /3) 
cos 2(2:±^) -3sin2(^i^ 


4sin2(^^^) 
cot^(^^) — 3 


2 


< (cot(^—)-3). 
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Hence, we have 

\\ad\ - 1| < (cot^(^^^) - 3), 

which is a contradiction. This proves the result. □ 


Theorem 4.6. Suppose S = 


a b 
c d 


'^andT=(^^ ^ = k, \X\ < 1 < \n\, 


generate a non-elementary discrete subgroup in SL(2,]HI). Suppose, 

I I /]—rnrr ^ + \/i “ p) 

\c\Vm\m = -^-, 

where S{X,p) = |//|(|$JA| + \^p\) < e and, e = or X depending on k 0 or k = 0 . 
We eonsider the Shimizu-Leutbechar sequenee 

Sn+l = SnTS-\ 

Then, for each n, {Sn,T) is a non-elementary discrete subgroup o/SL(2,]HI) and 

1 + — €~^S{X, p) 


ICjiI V^lYnl \ ln\ — 


where Tn = X{-Cn ^dn) + v + (Cn ^dn)p, tn = X{anCn ^) + V - (OnCn ^)/U. 


Proof. We prove the result assumeing k 7 ^ 0. The case k = 0 is similar. 

Consider the Shimizu-Leutbecher sequence Sq = S, Sn+i = SnTSn~^, where Sn = 
f On bfi\ 

\ W dfi J 

Now, 


'S'n+l 


Define Tn,tn by 

(4.5) 

(4.6) 

We see that 


SnTSn-^ 

fan bn'\ fx / C 

VW dn/ pj V“C 

f anXdj^ anPCj^ bnpc^ 

yCfiXd^ CnPC^ dnpC^ 


- 6 ~\ 

'-'n \ 

J 

+ ciYiTjCi^ \ 

C7^A6^ “h CfiTfO,^ dnfJjQj,^ J 


Tn — A( Cyi dn) 'f] {Cn dnjfJj 
tn — ^ V (^n^n )/i 


Cn+l 


So, |c 7 i+i| 


Cn^d^ Cn'^Cj^ dntlC^yi 

-Cn{X{-d:;;cf;~^) + 7? + (Cn"M„)^)c~ 
C-nTn^n 
I'^nCnl |Cn| 
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In a similar way we can have 

|l^n+l| ^ l7nCn||cin| “1“ 2r 

.2 

®n+l ^ (ZjT, H 

r 

Also, | 6 n+i| < lonP + n)\an\\bn\, as in the proof of Theorem 13.71 Also, we have 

|7n+lC^+l| ^ |7nCn,| T \/25'(A,/i) 

l^n+l^n+ll ^ ItViC^I T '\/25'(A,/i) 


Considering the sequence 

^0 = |c|\/|ro||to|, Xn+i = xl + V^SiX,^), where, 5(A,//) < 

Note that {xn} is a monotonically decreasing sequence of real numbers and is bounded 

above by _ gy hypothesis xq = . Hence {xn} must be 

a constant sequence. In particular, c„ 7 ^ 0 for all n and hence, and T can not have a 
common fixed point. Thus {Sn,T) is non-elementary. □ 

Corollary 4. 7. Let S — (^ d) ’ ^ ~ (0 /i) ’ where 3?A = |A| < 1 < l/ij, generate 

a discrete, non-elementary subgroup o/SL(2,]HI). Suppose 

xq = X{-c~^d)-\-r]-\-{c~^d)fi, 
to = X{ac~^)r] — {ac~^)p,. 

If 

ko -to\ ^ 1-1 , -I 

then {S, T) is not extreme. 


Proof. Without loss of generality, assume |A| < 1. Suppose {S,T) is extreme. Then 
|cp|Toto| = ^ 0 ^- Note that 

To — ^0 = —X{c~^d + ac~^) + {c~^d + ac~^)fi = ^X{c~^d + ac~^) + {c~^d + ac~^)'^p,. 
Thus 


To - to\ 


< 

< 


(|3A| + IQ'/iDdc ^d + ac ^ 

(|9=A| + \Qn\)-r^\cd + ac|.- 
c 


I) 

CpiTotol 


This implies 


Now note that S'(A,/i) < 


tq - tol 
koto I 


<SiX,p) 


\cd + ac| 




< 4 and Ko > 4, hence 

^ " ISin 


< 1. So, 
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This proves the result. 


□ 


If we choose T = 


A 0 

ri n 


, then analogous results to Theorem 14.61 and Corollary 14.71 


follow using similar arguments as above. 


Corollary 4.8. Let S = 


a b 
c d 


T = 


A 0 
V 


3?A = generate a discrete, non¬ 


elementary subgroup o/SL(2,EI). Suppose 

To = ii{-b~^a)-\-r]{b~^a)X, 


If 


to = ij,{db ^)-\-r] — {db ^)A. 
ko - to\ 


ko^ol 


> \bd ab\, 


then {S, T) is not extreme. 


4.1. Examples of Extreme Groups. Let us consider S = 


a 0 
c d 


T = 


A c 

0 /i 


€ 


SL(2,]H) with |c| > 1 and 9A = Xsfj. = 0. Suppose that the subgroup {S,T) in SL(2,B[) 
is non-elementary and discrete. For eg. if a = d = c = 1 and X = p. = 1 then this is the 
case. Then we see that tq = c~^j, to = c~^j and so we have |c| Y^|To||to| = 1, whereas 

we also observe that 5(A, /r) = 0 and so we have _ 2 _ ^ ^ have 
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